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ESTIMATING NOISE FOR A DIGITAL IMAGE 
UTILIZING UPDATED STATISTICS 
FIELD OF INVENTION 

The present invention relates to producing noise estimates from 
5 digital images which can be used for enhancing such digital images. 

BACKGROUND OF THE INVENTION 
Some digital image processing applications designed to enhance 
the appearance of the processed digital images take explicit advantage of the noise 
characteristics associated with the source digital images. For example, Keyes et 
10 al. in U.S. Patent No. 6,118,906 describe a method of sharpening digital images 
which includes the steps of measuring the noise components in the digital image 
with a noise estimation system to generate noise estimates; and sharpening the 
digital image with an image sharpening system which uses the noise estimates. 
Similarly, digital imaging applications have incorporated automatic noise 
15 estimation methods for the purpose of reducing the noise in the processed digital 
images as in the method described by Anderson et al. in U.S. Patent No. 
5,809,178. 

In commonly-assigned U.S. Patent No. 5,923,775, Snyder et al. 
disclose a method of image processing which includes a step of estimating the 

20 noise characteristics of a digital image and using the estimates of the noise 

characteristics in conjunction with a noise removal system to reduce the amount of 
noise in the digital image. The method described by Snyder et al. is designed to 
work well for individual digital images and includes a multiple step process for 
the noise characteristics estimation procedure. First the residual signal is formed 

25 from the digital image obtained by applying a spatial filter to the digital image. 
This first residual is analyzed to form a mask signal which determines what 
regions of the digital image more and less likely to contain image structure 
content. The last step includes forming a second residual signal and sampling the 
residual in image regions unlikely to contain image structure content to form the 

30 noise characteristic estimation. 
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In U.S. Patent No. 6,069,982, Reuman et al. describe a method of 
automatically estimating the noise characteristics of a digital image acquisition 
device which includes providing predetermined default values for the spatial noise 
characteristics of the digital image acquisition device, gathering information 
5 related to the spatial noise characteristics of the digital image acquisition device; 
generating replacement data in response to said gathered information; and 
updating said predetermined default spatial noise characteristics associated with 
the digital image acquisition device with said replacement data. In particular the 
method disclosed by Reuman et al. estimate the standard deviation (derived from 
10 the variance) as a function of the grey-level (pixel value) and the spatial frequency 
characteristics of the noise. The noise characteristics, such as a table of standard 
deviation values as a fixnction of grey-level, are provided as the default values. 
Each digital image to be processed is analyzed which includes the calculation of 
statistical quantities in the gathering of information step. These statistical 
15 quantities and the default values are combined to calculate the updated 
replacement noise characteristic values. 

The method described by Reuman et al. further teaches a method of 
selecting between a predetermined table of statistics and a using a captured digital 
image of interest to estimating noise characteristics. If there is no predetermined 
20 table of statistics, only then Reuman et al. use the captured digital image to 
estimate noise characteristics. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide an improved 
method of estimating noise in a digital image captured by a particular image 
25 source or medium. 

It is a further object of the present invention to make use of noise in 
a captured digital image to provide statistics which are representative of the image 
source. 

These objects are achieved in a method of estimating noise in a 
30 digital image, comprising the steps of: 



a) receiving a digital image; 

b) providing a first statistical table related to noise provided by 
an image source; 

c) using the pixels of the digital image to calculate a second 
statistical table related to the noise provided by the image source in capturing the 
image; 

d) using the first statistical table and the second statistical table 
to provide an updated third statistical table related to the noise provided by the 
image source in capturing the image; and 

e) calculating a noise characteristic table from the third 
statistical table for use in enhancing the digital image. 

It is an advantage of the present invention that the third statistical 
table can be updated based on noise provided by the latest digital image to be 
processed. It is a feature of the invention that it is adaptive and can adjust for 
variations that occur over time in a particular image capture source. It is a further 
advantage that the noise estimate provided to produce an image noise 
characteristic table can become a more accurate representation of the noise with 
each update. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a functional block diagram showing the component parts 
of an apparatus which can implement the present invention; 

FIG. 2 is a functional block diagram of a method of the image 
processor module employed by the preferred embodiment of the present invention; 
and 

FIG. 3 is a function block diagram of the noise estimation module 
used by the preferred embodiment of the present invention; and 

FIG. 4 is a function block diagram of the noise estimation module 
used by an alternative embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

In the following description, a preferred embodiment of the present 
invention will be described as a software program. Those skilled in the art will 
readily recognize that the equivalent of such software may also be constructed in 
5 hardware. Because image manipulation algorithms and systems are well known, 
the present description will be directed in particular to algorithms and systems 
forming part of, or cooperating more directly with, the method in accordance with 
the present invention. Other aspects of such algorithms and systems, and 
hardware and/or software for producing and otherwise processing the image 

10 signals involved therewith, not specifically shown or described herein may be 
selected from such systems, algorithms, components, and elements known in the 
art. Given the description as set forth in the following specification, all software 
implementation thereof is conventional and within the ordinary skill in such arts. 

The present invention may be implemented in computer hardware. 

15 Referring to FIG. 1, the following description relates to a digital imaging system 
which includes an image capture device 10a, an digital image processor 20, an 
image output device 30a, and a general control computer 40. The system may 
include a monitor device 50 such as a computer console or paper printer. The 
system may also include an input device control for an operator such as a 

20 keyboard and or mouse pointer 60. Multiple capture devices 10a, 10b, and 10c are 
shown illustrating that the present invention may be used for digital images 
derived from a variety of imaging devices. For example, FIG. 1 may represent a 
digital photofinishing system where the image capture device 10a is a 
conventional photographic film camera for capturing a scene on color negative or 

25 reversal film, and a film scarmer device for scanning the developed image on the 
film and producing a digital image. The digital image processor 20 provides the 
means for processing the digital images to produce pleasing looking images on the 
intended output device or media. Multiple image output devices 30a and 30b are 
shown illustrating that the present invention may be used in conjunction with a 

30 variety of output devices which may include a digital photographic printer and soft 
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copy display. The digital image processor processes the digital image to adjust 
the overall brightness, tone scale, image structure etc. of the digital image in a 
manner such that a pleasing looking image is produced by an image output device 
30a. Those skilled in the art will recognize that the present invention is not 
5 limited to just these mentioned image processing modules. 

The general control computer 40 shown in FIG. 1 may store the 
present invention as a computer program stored in a computer readable storage 
medium, which may comprise, for example: magnetic storage media such as a 
magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such 

10 as an optical disc, optical tape, or machine readable bar code; solid state electronic 
storage devices such as random access memory (RAM), or read only memory 
(ROM). The associated computer program implementation of the present 
invention may also be stored on any other physical device or medium employed to 
store a computer program indicated by offline memory device 70. Before 

15 describing the present invention, it facilitates understanding to note that the 

present invention is preferably utiUzed on any well-known computer system, such 
as a personal computer. 

It should also be noted that the present invention implemented in a 
combination of software and/or hardware is not limited to devices which are 

20 physically connected and/or located within the same physical location. One or 
more of the devices illustrated in FIG. 1 may be located remotely and may be 
connected via a wireless connection. 

A digital image is comprised of one or more digital image 
channels. Each digital image channel is comprised of a two-dimensional array of 

25 pixels. Each pixel value relates to the amovmt of Ught received by the image 

capture device 10 corresponding to the geometrical domain of the pixel. For color 
imaging applications a digital image will typically consist of red, green, and blue 
digital image chaimels. Other configurations are also practiced, e.g. cyan, 
magenta, and yellow digital image channels. For monochrome applications, the 

30 digital image consists of one digital image channel. Motion imaging applications 
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can be thought of as a time sequence of digital images. Those skilled in the art 
will recognize that the present invention can be applied to, but is not limited to, a 
digital image channel for any of the above mentioned applications. In fact, the 
present invention can be applied to any two dimensional array of noise corrupted 
5 data to obtain an estimated noise table. Although the present invention describes a 
digital image channel as a two dimensional array of pixel values arranged by rows 
and columns, those skilled in the art will recognize that the present invention can 
be applied to mosaic (non rectilinear) arrays with equal effect. 

The digital image processor 20 shown in FIG. 1 is illustrated in 

10 more detail in FIG. 2. The general form of the digital image processor 20 
employed by the present invention is a cascaded chain of image processing 
modules. The source digital image 201 is received by the digital image processor 
20 which produces on output an enhanced digital image 204 and an estimated 
noise characteristic table 207. The noise estimation module 1 10 receives the 

15 source digital image 201 and the default residual histogram 205 and produces an 
estimated noise characteristic table 207 and an updated residual histogram. The 
updated residual histogram replaces the default residual histogram 205 for the next 
source digital image 201 to be processed. Each image processing module 
contained within the digital image processor 20 receives a digital image, modifies 

20 the digital image, produces a processed digital image and passes the processed 
digital image to the next image processing module. The two enhancement 
transform modules shown within the digital image processor 20 are a noise 
reduction module 22 and a spatial sharpening module 23. These two modules use 
the estimated noise characteristic table 207 produced by the noise estimation 

25 module 110 to produce the enhanced digital image 204. Those skilled in the art 
will recognize that any other image processing module that utilizes an estimated 
noise characteristic table 207 can be used with the present invention. 

The noise estimation module shown in FIG. 2 is illustrated in more 
detail in FIG. 3. The residual transform module 120 receives the source digital 

30 image 201 and apphes a spatial filter to the source digital image 201 which results 
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in a residual digital image. The residual statistics accumulator 130 receives the 
residual digital image and calculates a set of local residual histograms from the 
pixel data of the residual digital image. The residual statistics accimiulator 130 
also receives a set of default residual histograms 205 and combines the set of local 
5 residual histograms and the set of default residual histograms 205 to produce a set 
of updated residual histograms. The noise table calculator 140 receives the 
updated residual histograms and produces a noise characteristic table 207. 

The residual transform module 120 performs a spatial filtering 
operation on the pixel data of the source digital image 201. That is, a residual 

10 pixel value is generated for each original pixel value in the source digital image 
201 . The residual pixel values constitute the residual digital image. For each 
pixel of interest, a combination of pixel values sampled from a local region of 
pixels is used to form the residual pixel value. If the source digital image 201 is a 
color digital image, the residual transform module 120 performs the spatial 

15 filtering operation on each color digital image channel and forms a residual pixel 
value for each pixel of each color digital image channel. The preferred 
embodiment of the present invention uses a two-dimensional Laplacian operator 
as the spatial filter to form the residual pixel values. The Laplacian operator 
calculates a local arithmetic mean value from the value of pixel sampled from the 

20 local region of pixels about the pixel of interest and subtracts the value of the pixel 
of interest from the local arithmetic mean value. A local region of 3 by 3 pixels is 
used. The Laplacian operator is convolution spatial filter with an associated 
convolution kernel of: 

1 1 1 

1-11. (1) 
1 1 1 

25 Although the preferred embodiment of the present invention uses a two 

dimensional Laplacian based spatial filter, those skilled in the art will recognize 
that the present invention can be practiced with other spatial filters, such as but not 
Hmited to, one-dimensional Laplacian spatial filters. 



An alternative embodiment of the present invention uses the 
method disclosed by Snyder et al. in commonly-assigned U.S. Patent No. 
5,923,775. In this alternative embodiment, a similar technique of forming a 
residual pixel value is performed. Next, a gradient signal is calculated using a 
spatial filter. The gradient signal is analyzed to form a masking signal that is used 
to reject some of the residual pixel values from later consideration. Although this 
alternative embodiment leads to more accurate noise estimation it is also more 
computationally intensive than the preferred embodiment. 

The residual statistics accumulator 130 shown in FIG. 3 is 
described in more detail. The pixel data of the source digital image 201 can be 
conceptualized as having two components - a signal component relating to 
photographed objects and a noise component. The resulting residual pixel values 
have statistical properties that have a closer relationship to the noise component of 
the pixel data of the source digital image 201 than the signal component. 
Although the noise component can contain sub-components, the stochastic sub- 
component of the noise component is well modeled by a zero mean Gaussian 
probability distribution function. To first order, the noise component of the pixel 
data of the source digital image 201 can be characterized by a standard deviation 
and a mean value of zero. To second order, standard deviation of the noise 
component can be modeled as being signal and color channel dependent. 

The residual transform module 130 analyzes the residual pixel values and 
records these values in the form of a set of local residual histograms as a function 
of the color digital image channel and pixel value. Therefore a given local 
residual histogram relates to the i* color digital image channel and the k"" pixel 
value sub-range. For each pixel of interest denoted by p^ (corresponding to the 
m* row and n"" column location) in the processed color digital image channel, a 
histogram bin index k is computed. For example, if the numerical range of pixel 
values is from 0 to 255 there can be as many as 256 useflil histograms, i.e. one 
histogram for each possible numerical pixel value. In general, most noise sources 
can be characterized as having noise standard deviations that are slow functions of 
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the pixel value. Therefore, the preferred embodiment of the present invention uses 
8 histograms to cover the numerical pixel value range of 0 to 255. Thus the 
calculated histogram index bin and the corresponding sub-range pixel values are 
given by the follovi^ing table (1). 
5 Table (1) 



histogram bin index 


sub-range pixel values 


average pixel value 


0 


Oto31 


16 


1 


32 to 63 


48 


2 


64 to 95 


80 


3 


96 to 127 


112 


4 


128 to 159 


144 


5 


160 to 191 


176 


6 


192 to 233 


208 


7 


234 to 255 


240 



Those skilled in the art will recognize that the present invention can be practiced 
with digital image pixel data with any numerical range. The number of local 
residual histograms used for each color digital image channel will depend on the 

10 accuracy of results required for the particular digital imaging application. 

Although each local residual histogram records statistical 
information for a range of pixel values for a given color digital image channel, the 
local residual histogram records the frequency of residual pixel values associated 
with each pixel of interest p^. Since the expected mean of the distribution of 

15 residual pixel values is zero, the residual pixel values exhibit both positive and 
negative values. Therefore, the local residual histogram must record the 
frequency, i.e. the number of instances of residual pixel values, of all possible 
instances of residual pixel values. For the example above, the residual pixel 
values can range from -255 to +255. While is possible to construct local residual 

20 histograms with as many recording bins as there are possible instances of residual 
pixel values, in general this is not necessary. For most digital images only a small 
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percentage of residual pixel values exhibit values near the extremes of the possible 
range. The present invention uses 101 total recording bins for each local residual 
histogram. On of the recording bins corresponds to residual pixel values of 50 and 
greater. Similarly, one other recording bin corresponds to residual pixel values of 
-50 and lower. The other 99 recording bins each correspond to a single residual 
pixel value for the numerical range from -49 to +49. 

The residual statistics accumulator 130 combines the data 
contained in the local residual histograms with data contained in the default 
residual histograms 205. While the local residual histograms record residual pixel 
values as derived from the currently processed source digital image 201, the 
default residual histograms 205 record the residual pixel values as derived from 
the previously processed digital images. Thus the default residual histograms 205 
have the same form as the local residual histogram, i.e. one local residual 
histogram for each pixel value sub-range of each color digital image channel. 

The present invention uses more than one method of combining the 
local residual histograms with the default residual histograms 205, however, each 
method combines a single local residual histogram with the corresponding defauh 
residual histogram 205. Therefore, it is appropriate to discuss the method with 
respect to the combination of two histograms with the assumption that each 
combining method is repeated for all the pairs of corresponding histograms. 

The preferred embodiment of the present invention uses a direct 
method of combining the data contained in the local residual histogram and 
defauh residual histogram 205. That is, the numbers contained in each recording 
cell of the local residual histogram are added directly to the corresponding 
recording cell of the default residual histogram 205. Thus after the combining 
step has been performed, the updated values of each recording cell is given by the 
sum of the previous value of the recording cell with the value contained in the 
corresponding recording cell of the local residual histogram. 
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Since the recording cells of the default residual histogram 205 
contains the sum total of residual pixel values derived from the source digital 
image 201 as well as previous processed digital images, the numerical range of the 
computer implementation can be exceeded. To avoid a numerical overflow 
5 condition the default residual histogram 205 can be re-normalized. The process of 
re-normalization includes scanning the values of the recording cells to determine 
the maximum value, comparing this maximum value to a predetermined allowable 
value. If the maximum value is greater than the a predetermined allowable value 
the values of all the recording cells are divided by a constant numerical factor. 
10 This process of re-normalization of the default residual histogram 205 can be 
performed either before or after the process of combining the local residual 
histogram with the default residual histogram 205. The preferred embodiment of 
the present invention performs the re-normalization process before the combining 
process. 

15 An altemative embodiment of the present invention produces the 

updated residual histogram by calculating a weighted average between the default 
residual histogram 205 and the local residual histogram. For each recording cell 
of the default residual histogram 205 RC^j and its corresponding recording cell of 
the local residual histogram RC, , the updated recording cell value RC^ is 

20 calculated using the formula: 

RC, = P RCd + (1 - p) RC, (2) 

where the variable P is a numerical weighting factor. The present invention uses P 
value of 0.99 for a which heavily weights the contribution of the default residual 
histogram 205. 

25 Referring to FIG. 3, the noise table calculator 140 receives the 

updated residual histograms and calculates a noise characteristic table 207. For 
each of the updated residual histograms relating to a particular color digital image 
channel and pixel value range, the noise table calculator 140 derives a noise 
standard deviation value from the value of the recording cells of the updated 
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residual histogram. The preferred embodiment of the present invention uses 
equation (3) to calculate the standard deviation value cr^ 

CT„ = ((1/N) 2:,RC.(k) (x-xj^ (3) 
where the variable x represents the average pixel value of the residual pixel values 
accumulated in the k*^ recording cell as given by Table (1) and RCv(k) represents 
the number of residual pixel values accumulated by the k* recording cell. 

X = V(k) (4) 
The variable x„ represents the arithmetic mean value of the corresponding residual 
pixel values given by equation (5) and , 

x^ = (l/N)E, X (5) 
and the variable N represents the total number of residual pixel values recorded by 
the updated residual histogram given by equation (6). 

N = RC,(k) (6) 
An alternative embodiment of the present invention performs an 
alpha-trimmed standard deviation calculation. In this embodiment a first 
approximation to the standard deviation (j^ is calculated using the method 
described above. The calculation of a„ is then calculated using the only recording 
cells with corresponding residual pixel values that are within a limited range of 
zero. The formula for the standard deviation calculation a„ is given by equation 
(7) 

a, = ((1/N) SkyRa(k) (x-xj (7) 
where the variable y is given by equation (8) 



y = 1 if|x|<a*ae 



(8) 
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where the variable a is set to 3.0. This alternative embodiment of the present 
invention is more computationally intensive than the preferred embodiment but 
does yield more accurate results via the rejection of out-lying residual pixel values 
from adversely contributing to the calculation of the standard deviation cj„ value. 

Table 2 below is an example of a noise characteristic table 
produced with the present invention. 

Table (2) 



average pixel 
value 


Standard 
deviation of red 
channel 


Standard 
deviation of 
green channel 


Standard 
deviation of 
blue channel 


16 


3.28 


3.62 


3.21 


48 


3.71 


3.20 


3.38 


80 


3.77 


4.14 


4.50 


112 


4.57 


4.35 


4.21 


144 


4.98 


4.25 


4.37 


176 


5.05 


4.11 


6.21 


208 


5.05 


5.64 


6.29 


240 


2.71 


4.27 


3.87 



The present invention uses a set of residual histograms to record 



the calculated statistics. A set of histograms is an example of a statistical table 
from which a noise characteristic table can be derived. Thus the set of local 
residual histograms constitutes a local statistical table, the set of default residual 
histograms 205 constitutes a default statistical table and the set of updated residual 
histograms constitutes an updated statistical table. Those skilled in the art should 
recognize that the present invention can be practiced with other forms of statistical 
tables. For example, the residual digital images could be stored and serve as a 
statistical table. 

It should be noted that the present invention uses a set of residual 
histograms as the form for the statistical table due to its inherent computational 
and storage simplicity. However, the present invention can be practiced by 
recording a default noise characteristic table 208 instead of recording the residual 
histograms. FIG. 4 shows the details of an alternative embodiment of the noise 
estimation module 110. The residual transform module 120 receives the source 
digital image 201 and calculates a residual digital image. The residual statistics 
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accumulator 130 receives the residual digital image and calculates a set of local 
residual histograms from the pixel data of the residual digital image as described 
above. . The noise table calculator 140 receives the local residual histograms and 
produces a local noise characteristic table. The noise table generator 150 receives 

5 the local noise characteristic table and the default noise characteristic table 208 
and produces an updated noise characteristic table 207. This updated noise 
characteristic table 207 replaces the default noise characteristic table 208 for the 
next source digital image 201 to be processed. The local noise characteristic table 
and default noise characteristic table 208 are combined by calculating a linear 

10 combination of these two tables element for element. Good values for the linear 
combination coefficients are 0.99 contribution for the default noise characteristic 
table 208 values and 0.01 for the local noise characteristic table values. Although 
this alternative embodiment of the present invention can be used to generate 
robust noise characteristic tables, the preferred embodiment generally produces 

15 more accurate results. 

The calculated noise characteristic table 207 is used in conjunction 
with spatial filters to produce an enhanced digital image 204 from the source 
digital image 201 . A spatial filter is any method which uses pixel values sampled 
from a local region about a pixel of interest to calculate an enhanced pixel value 

20 which replaces the pixel of interest. Those spatial filters which reduce spatial 
modulation, for at least some pixels in an effort to remove noise from the 
processed digital image, can be considered noise reduction filters. Those spatial 
filters which increase spatial modulation, for at least some pixels in an effort to 
enhance spatial detail noise in the processed digital image, can be considered 

25 Spatial sharpening filters. It should be noted that it is possible for a single spatial 
filter to be considered both a noise reduction filter as well as a spatial sharpening 
filter. The present invention can be used with any digital image processing 
method which makes uses of a noise characteristic table to produce an enhanced 
digital image 204. 



-15- 



Refening to FIG. 3, the preferred embodiment of the present 
invention employs a noise reduction module 22 as part of the image processing 
method to produce an enhanced digital image 204. As such, the source digital 
image 201 and the noise characteristic table 207 are received by the noise 

5 reduction module 22 which produces on output a noise reduced digital image. 

It is important to note that for many practical digital imaging image 
systems, other image processing processors need to be included. As long as these 
other image processing processors accept a digital image as input and produce a 
digital image on output, one more of these type of image processing processors 

10 can be inserted in the image processing chain in between a noise reduction module 
22 and a spatial sharpening module 23. 

The present invention uses a modified implementation of the Sigma 
filter, described by Jong-Sen Lee in the journal article Digital Image Smoothing 
and the Sigma Filter, Computer Vision, Graphics, and Image Processing Vol 24, 

15 p. 255-269, 1983, as a noise reduction filter to enhance the appearance of the 
processed digital image. The values of the pixels contained in a sampled local 
region, n by n pixels where n denotes the length of pixels in either the row or 
column direction, are compared with the value of the center pixel, or pixel of 
interest. Each pixel in the sampled local region is given a weighting factor of one 

20 or zero based on the absolute difference between the value of the pixel of interest 
and the local region pixel value. If the absolute value of the pixel value difference 
is less or equal to a threshold s, the weighting factor if set to one. Otherwise, the 
weighting factor is set to zero. The numerical constant 8 is set to two times the 
expected noise standard deviation. Mathematically the expression for the 

25 calculation of the noise reduced pixel value is given as 

q_= E,, a,^ p, a, (9) 

and 

% = 1 if IPij-Pn:nl<=e 



ajj = 0 if I Pij - p^ I > E 
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where p,j represents the ij* pixel contained in the sampled local region, p^ 
represents the value of the pixel of interest located at row m and column n, a^ 
represents a weighting factor, and represents the noise reduced pixel value. 
Tj^ically, a rectangular sampling region centered about the center pixel is used 
5 with the indices i and j varied to sample the local pixel values. 

The signal dependent noise feature is incorporated into the 
expression for s given by equation (11) 

s= 5/«ccr„(p^) (10) 

where c„ represents the noise standard deviation of the source digital image 201 

10 evaluated at the center pixel value p^ as described by equations (3) and (8) above. 
The parameter Sfac is termed a scale factor can be used to vary the degree of noise 
reduction. The calculation of the noise reduced pixel value q^^ as the division of 
the two sums is then calculated. The process is completed for some or all of the 
pixels contained in the digital image channel and for some or all the digital image 

15 channels contained in the digital image. The noise reduced pixel values constitute 
the noise reduced digital image. The modified implementation of the Sigma filter 
is an example of a noise reduction method that uses a noise characteristic table. 

Referring to FIG. 3, the preferred embodiment of the present 
invention employs a spatial sharpening module 23 as part of the image processing 

20 method to produce an enhanced digital image 204. As such, the noise reduced 
digital image and the noise characteristic table 207 are received by the spatial 
sharpening module 23 which produces on output an enhanced digital image 204. 

Although the present invention can be used any spatial sharpening 
filter which utilizes a priori knowledge of the noise characteristics, the preferred 

25 embodiment uses a modified implementation of the method described by Kwon et 
al in U.S. Patent No. 5,081,692. This spatial sharpening method performs an un- 
sharp masking operation by filtering the input digital image with a spatial 
averaging 2-dimensional Gaussian filter (characterized by a standard deviation of 
2.0 pixels) which results in a blurred digital image. The blurred digital image is 

30 subtracted from the input digital image to form a high-pass residual. In the 
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method disclosed by Kwon et al. A local variance about a pixel of interest is 
calculated by using the pixel data fi-om the high-pass residual. Based on the value 
of the local variance a sharpening factor is adjusted so as to amplify large signals 
more than small amplitude signals. The amplification factor ^ is therefore a factor 
5 of the local variance v. i.e. (j)(v). 

The present invention modifies the method taught by Kw^on et al. to 
make the amplification factor ^(v) a function of the estimated noise, i.e. (|)(v,a„). 
The amphfication fimction cj) is given by a gamma function, or integral of a 
Gaussian probability ftmction, as given by equation (1 1). 

where yo represents a minimum amphfication factor ymax represents a maximum 
amphfication factor, v^ax 'represents a maximum abscissa value of the variable v, 
Vq represents a transition parameter and cr represents a transition rate parameter. 
The variable Vq is a function of the noise standard deviation value as per 
15 equation (12) 

vo- Sfac2<yAp^^) (12) 
where the scaling factor Sfac2 determines the sensitivity of the sharpening 
sensitivity to the noise and the noise standard deviation value cr„ is as described 
above in equations (3) and (8). The optimal values for the variables used in 

20 equation (13) depend on the digital imaging application. The present invention 
uses a value of 1 .0 for Yq which results in no spatial sharpening for noisy regions. 
A value of 3.0 is used for ymax' however, this variable is sensitive to user 
preference with values ranging from 2.0 to 4.0 producing acceptable results. The 
value of Sfac2 should be set to between 1.0 and 2.0 with 1.5 as optimal. The 

25 variable s should be set to values in the range from Vq / 2 to Vq / 10 for reasonable 
results. The variable v^ax should be set to a value much larger than the expected 
noise, e.g. 20 time the value of a^. 
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The above discussion has included details of practicing the present 
invention for source digital images of general type. However, most digital 
imaging systems accept digital images from a variety of sources. For example, the 
image capture device 10a and 10b shown in FIG. 1 could be a photographic film 
5 scanner while the image capture device 1 Oc could be a digital camera or digital 
camcorder. The image capture device can contribute add noise to the digital 
images it produces, the inherent noise in the capture medium usually dominates 
the overall noise characteristics of the resultant digital images. For example, 
while a photographic film scanner can produce digital images from any 

10 photographic film sample, in general, some photographic films are inherently 

noisier that others. A photographic film sample is an example of a photographic 
image. Other examples of photographic images can include, but are not limited to, 
a CCD imaging electronic device and a photographic print. 

In this alternative embodiment of the present invention, the image 

15 capture devices 10a, 10b, and 10c shown in FIG. 1 are capable of producing a 
source type identification tag 202 which uniquely identifies the source digital 
image 201 as belonging to a particular group. In the example given above, a 
photographic film sample Kodak Generation 6 Gold 200 film is scanned by the 
image capture device 10a which produces a source digital image 201 and a source 

20 type identification tag 202. The source type identification tag 202 identifies the 
source digital image 201 as being derived from Kodak Generation 6 Gold 200 
film. In this alternative embodiment of the present invention a default statistical 
tables is used in conjunction with the pixels from the source digital image 201 to 
produce a noise characteristic table 207 for the source digital image 201 as 

25 described above. However, the digital imaging system, shown in FIG.l, stores a 
default statistical table corresponding to each unique a source type identification 
tag 202. Thus the default statistical table corresponding to Kodak Generation 6 
Gold 200 film is used to process the source digital image 201 derived from the 
scanning the Kodak Generation 6 Gold 200 film sample with the image capture 

30 device 10a. It is important to note that if a different sample of Kodak Generation 
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6 Gold 200 film is scanned by the image capture device 10b, the same default 
statistical table corresponding to Kodak Generation 6 Gold 200 film is used. Thus 
the default statistical table is selected on the basis of the type photographic film 
and not on the type of or individual unit image capture device. This feature of the 

5 present invention allows the default statistical table, and consequently the resultant 
calculated noise characteristic table 207, to track or relate to the type of 
photographic film manufactured. Since the present invention automatically 
updates the default statistical tables and can derive the default statistical tables 
firom the pixel values of digital images, the present invention can be used with 

10 new types of manufactured photographic film without the need of a disseminated 
data base of either statistical tables or noise characteristic tables. 

Those skilled in the art will recognized that this feature of the 
present invention can easily be extended to include other sources of digital 
images. For example, the image capture device 10c can be a digital still camera, 

15 such as the Kodak DCS 290. For this example, the image capture device 10c 
produces a unique source type identification tag 202. In this manner any newly 
produced digital camera which produces a new and unique source type 
identification tag 202 can be processed effectively with the present invention. 
When the digital imaging systems shown in FIG. 1 encounters a previously 

20 unknown source type identification tag 202, a new default statistical table is 
created. 

In another alternative embodiment of the present invention the 
digital imaging system shown in FIG. 1 maintains a separate database of default 
statistical tables, one for each source identification tag, for each image capture 
25 device 10a and 10b. Since the image capture device can contribute some noise to 
the digital images it produces, maintaining separate databases of default statistical 
tables for each image capture device results in more accurate noise characteristic 
tables. 
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While the preferred embodiment of the present invention calculates 
a noise characteristic table and then subsequently uses the noise characteristic 
table to produce an enhanced digital image 204, some digital imaging systems 
may choose to separate the calculation phase from the enhancement phase. In an 

5 alternative embodiment of the present invention, the calculated noise characteristic 
table 207 is stored with the source digital image 201 as meta-data, i.e. non-pixel 
information. The source digital image 201 with meta-data can be transmitted to a 
remote site or stored for safe keeping to be used at a later time or another site. 
Any of the above mentioned noise characteristic tables (the local noise 

10 characteristic table, the default characteristic table or the updated characteristic 
table) can be stored as meta-data. In general a noise characteristic table requires 
much less memory storage than a set of residual histograms. In a still further 
alternative embodiment of the present invention a set of residual histograms is 
stored with the source digital image 201 as meta-data. 

15 The invention has been described in detail with particular reference 

to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 



10 


image capture device 


20 


digital image processor 


22 


noise reduction module 


23 


spatial sharpening module 


30 


image output device 


40 


general control computer 


50 


monitor device 


60 


input control device 


70 


offline memory device 


110 


noise estimation module 


120 


residual transform module 


130 


residual statistics accumulator 


140 


noise table calculator 


201 


source digital image 


202 


source type identification tag 


204 


enhanced digital image 


205 


default residual histogram 


207 


noise characteristic table 


208 


default noise characteristic table 
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WHAT IS CLAIMED IS: 

1 . A method of estimating noise in a digital image, comprising 

the steps of: 

a) receiving a digital image; 

b) providing a first statistical table related to noise provided by 
an image source; 

c) using the pixels of the digital image to calculate a second 
statistical table related to the noise provided by the image source in capturing the 
image; 

d) using the first statistical table and the second statistical table 
to provide an updated third statistical table related to the noise provided by the 
image source in capturing the image; and 

e) calculating a noise characteristic table fi-om the third 
statistical table for use in enhancing the digital image. 

2. The method of claim 1 wherein the first statistical table is 
either an initial default statistical table or an updated third statistical table. 

3. The method of claim 2 wherein the initial default statistical 
table relates to a noise estimate of that noise which will be provided by the image 
source in capturing the image. 

4. The method of claim 1 wherein the first, second, and third 
statistical tables each include a series of standard deviation values for different 
ranges of intensities provided by the captured image source. 

5. The method of claim 1, wherein the first, second, and third 
statistical tables each include at least one histogram. 

6. The method of claim 1 wherein the first, second, and third 
statistical tables each include a series of histograms for different ranges of 
intensities provided by the captured image source. 

7. The method of claim 4 wherein the standard deviation 
values of the third statistical table are used in calculating the noise characteristic 
for enhancing the digital image. 
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8. The method of claim 4 wherein the noise characteristic is 
use in processing the digital image for enhancing such digital image. 

9. The method claimed in claim 8, wherein a spatial filter is 
used to calculate the enhanced digital image. 

10. The method claimed in claim 8, further including the step of 
using the noise characteristic table and a noise reduction filter to calculate an 
enhanced digital image. 

1 1 . The method claimed in claim 8, further including the step of 
using noise characteristic table and a spatial sharpening filter to calculate an 
enhanced digital image. 

12. The method claimed in claim 8, further including the step of 
using noise characteristic table, a noise reduction filter and a spatial sharpening 
filter to calculate an enhanced digital image. 

13. A method of estimating noise in a photographic image, 
comprising the steps of: 

a) receiving a digital image corresponding to the photographic 
image and a source identification tag corresponding to the photographic image 
capture source; 

b) providing a first statistical table related to noise provided by 
a photographic image source; 

c) using the pixels of the digital image to calculate a second 
statistical table related to the noise provided by the photographic image source; 

d) using the first statistical table and the second statistical table 
to provide an updated third statistical table related to the noise provided by the 
photographic image source; and 

e) calculating a noise characteristic table related to the noise 
provided by the photographic image source firom the third statistical table for use 
in enhancing the digital image. 

14. The method of claim 13 wherein the first statistical table is 
either an initial default statistical table or an updated third statistical table. 
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1 5 . The method of claim 14 wherein the initial default 
statistical table relates to a noise estimate of that noise which will be provided by 
the image source in captiiring the image. 

16. The method of claim 13 wherein the first, second, and third 
statistical tables each include a series of standard deviation values for different 
ranges of intensities provided by the captured image source. 

17. The method of claim 13, wherein the first, second, and third 
statistical tables each include at least one histogram. 

18. The method of claim 13 wherein the first, second, and third 
statistical tables each include a series of histograms for different ranges of 
intensities provided by the captured image source. 

1 9 . The method of claim 1 7 wherein the standard deviation 
values of the third statistical table are used in calculating the noise characteristic 
for enhancing the digital image. 

20. The method of claim 17 wherein the noise characteristic is 
use in processing the digital image for enhancing such digital image. 

21 . The method claimed in claim 20, wherein a spatial filter is 
used to calculate the enhanced digital image. 

22. The method claimed in claim 20, fiirther including the step 
of using the noise characteristic table and a noise reduction filter to calculate an 
enhanced digital image. 

23 . The method claimed in claim 20, further including the step 
of using noise characteristic table and a spatial sharpening filter to calculate an 
enhanced digital image. 

24. The method claimed in claim 20, fiirther including the step 
of using noise characteristic table, a noise reduction filter and a spatial sharpening 
filter to calculate an enhanced digital image. 
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ABSTRACT 

A method of estimating noise in a digital image receiving a digital 
image; providing a first statistical table related to noise provided by an image 
source; and using the pixels of the digital image to calculate a second statistical 

5 table related to the noise provided by the image source in capturing the image. 
The method further includes using the first statistical table and the second 
statistical table to provide an updated third statistical table related to the noise 
provided by the image source in capturing the image; and calculating a noise 
characteristic table from the third statistical table for use in enhancing the digital 

10 image. 
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Combined Declaration For Patent Application and Power of Attorney i attorney docket 

I 81759RLO 

As below named inventor, I hereby declare that: 
My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the origmal, first and sole mventor (if only one name is listed below) or an onginal, first and joint inventor (if plural names are listed 
below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 

ESTIMATING NOISE FOR A DIGITAL IMAGE UTILIZING UPDATED STATISTICS 

The specification of which (check only one item below): 

X I is attached hereto. 

! was filed as United States Application Serial No. on and 
was amended on (if applicable). 

I was filed as PCTInternational application Number on and was amended under PCI Article 19 on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, as amended by any amendment 
referred to above. 

I acknowledge the duty to disclose to the U.S. Patent & Trademark Office all information known to me to be matenal to patentability as defined in Title 
37, Code of Federal Regulations, §1.56 

thereby claim foreign pnonty benefits under Title 35, United States Code, §119 of any foreign application(s) for patent or inventor's certificate or of any 
PCT international application(s) designating at least one counti-y other than the United States of America listed below and have also identified below any 
foreign applicabons(s) for patent or inventor's certificate or any PCT international application(s) designating a least one country other than the United 
States of America filed by me on the same subject matter having a filing date before that of the application(s) of which pnority is claimed: 
PRIOR FOREIGN/PCT APPLICATION (S) AND ANY PRIORITY CLAINIS UNDER 35 U.S.C. 119: ~ 



I hereby claim the benefit under Title 35, United States Code, 119 §(e) of any United States provisional apphcation(s) listed below: 
PRIOR PROVISIONAL APPLICATION(S) AND ANY PRIORITY CLAIMS UNDER 35 U.S.C. §119 (e): 



I hereby claim the benefit under Title 35, United States Code, §120 of any prior United States application(s) or PCT international application(s) 
designating the United States of Amenca that is/are listed below and, insofar as the subject matter of each of the claims of this application is not disclosed 
m that/those prior applications(s) in the manner provided by the first paragraph of Title 35, §1 12, 1 acknowledge the duty to disclose to the U.S. Patent 
Trademark Office all information known to me to be material to patentabiHty as defined in Titie 37, Code of Federal Regulations §1.56, which became 
available between the filing date of the prior applicabon(s) and the national or PCT international filing date of this application: 



PRIOR US APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U.S FOR BENEFIT UNDER 
35USC§120: 
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this application and transact all business in the Patent and Trademark Office connected 
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Patent Legal Staff 
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